Video tutorial of this gist file : https://www.youtube.com/watch?v=kmT-z2lqEPQ

Used web UI commit hash id: a9eef1fbb1dcdce4f0eb0b8e0f79dcd4c96713e1

Used ControlNet commit hash id : 241c05f8c9d3c5abe637187e3c4bb46f17447029

git checkout a9eef1fbb1dcdce4f0eb0b8e0f79dcd4c96713e1

git checkout master

video frame extract command

ffmpeg -i "input_video.mp4" -vf "fps=29.97" -start_number 1000 -q:v 1 %04d.png

the used script source : https://xanthius.itch.io/multi-frame-rendering-for-stablediffusion